Measurement and Particle Statistics in the Szilard Engine 
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A Szilard Engine is a hypothetical device which is able to extract work from a single thermal 
reservoir by measuring the position of particles within the engine. We derive the amount of work 
that can be extracted from such a device in the low temperature limit. Interestingly, we show this 
work is determined by the information gain of the initial measurement rather than by the number 
and type of particles which constitute the working substance. Our work provides another clear 
connection between information gain and extractable work in thermodynamical processes. 



The laws of thermodynamics are well known for their 
robustness, namely the fact that they survived both 
physics revolutions of the 20th century. Neither quan- 
tum physics nor relativity have modified our confidence 
in the fact that the overall energy of a closed system 
should be conserved, while its entropy tends to the max- 
imum value with time. At low temperatures, however, 
quantum systems obey completely different statistics to 
classical ones and one could imagine that bosonic and 
fermionic statistics, while not breaking the laws of ther- 
modynamics, might still allow us to obtain more work 
from indistinguishable particles than from the same num- 
ber of distinguishable ones. This has indeed recently been 
reported in [l[. 

In this Letter we show that the performance of a work 
cycle with indistinguishable particle depends on the in- 
formation one has and is capable of obtaining about 
them. The type of particles doing the work, be they 
classical, quantum, distinguishable or indistinguishable, 
is only of secondary importance. Our work clarifies why 
the basics of thermodynamics are independent of par- 
ticle statistics, a fact that makes thermodynamical laws 
all the more remarkable. Furthermore, it emphasises that 
the second law ought to most appropriately be phrased 
in terms of a trade-off between information gained and 
work done. 

In this letter we use the concept of the Szilard engine 
(SZE) [2|, y] - a hypothetical device which consists of a 
cylinder, serving as a heat reservoir at temperature T, 
containing a single gas particle. The engine works by 
dividing the cylinder into two halves by an impenetra- 
ble barrier and measuring the position of the gas parti- 
cle. Following the measurement, work can be extracted 
from this device by exploiting the pressure created by 
the particle on the barrier. The amount of work is given 
as fcTln(2) with k being the Boltzmann constant. As 
was identified by Bennett [J] , the validity of the second 
thermodynamical law is saved by the fact that the in- 
formation about the position of the particle before the 
work has been done, or, equivalently, about the position 
of the barrier after the work has been done, has to be 
stored somewhere and erased by "resetting" the engine. 



i.e. removing the barrier and moving it to the middle 
again. 

A natural extension of the original SZE is to include 
more particles into the engine. In e.g. [J, Ifl lZ| it was 
shown that correlations have a positive impact on the 
amount of work that can be extracted from the engine, 
quantum correlations having a particularly strong im- 
pact. A related important type of multi-particle effect is 
of course particle statistics associated with identical par- 
ticles. In a recent paper Kim et. al. [jj performed a full 
quantum analysis of a SZE with more than one particle, 
bringing the role of particle statistics into focus. 

In this Letter we clarify the role of particle statistics in 
a quantum SZE by placing a particular emphasis on the 
initial measurement. We consider the low temperature 
limit as we are interested in quantum effects and these 
are most strongly manifested in this regime. We show 
that the extractable work is directly connected with the 
measurement performed on the system. Crucially, for 
a measurement with M outcomes, the work is bounded 
from above hy W = kT\n{M) and reaches this bound 
only for measurements with equiprobablc outcomes. In 
other words, we find that the extractable work is de- 
termined by the information gained during the initial 
measurement, regardless of whether the working medium 
consists of distinguishable, bosonic or fermionic particles. 
By performing a detailed analysis we show that the work 
costs of the different steps do depend on the working 
medium but conspire to remove this dependence when 
combined. 

Szilard Engine. — Consider N particles (bosons, 
fermions or distinguishable particles) placed in a cylinder 
kept at a constant temperature T via the ongoing inter- 
action between the particles and the walls of the cylinder. 
This interaction is considered to be fast in the sense that 
the time scale of thermalization is much smaller than any 
other time scale used. In the first part of the Letter we 
will also assume the energy levels of the particles in the 
cylinder, as well as in its parts after inserting the barrier 
(piston), to be non-degenerate. However this does not 
exclude the energy levels on the respective side of the 
piston having the same energies. 



The original quantum SZE is used to extraet work from 
a temperature reservoir via the following steps: 

1. A piston (modelled by a sufRciently narrow and 
high potential barrier) is inserted into the cylinder to 
separate it into two disconnected regions, preventing any 
tunneling within the relevant time-scales. The work cost 
of this step shall be called Wl. 

2. A measurement is performed to obtain the number 
of particles on one side of the cylinder. This measure- 
ment might be full, i.e. providing the exact number of 
particles (or position in the case of distinguishable par- 
ticles) or partial. The state of particles in the cylinder, 
after the wall was inserted and before the measurement 
is performed, is a mixture of possible states obtained via 
the measurement rather then their coherent superposi- 
tion. This is due to the fact that interactions with the 
walls of the cylinder will not only fix the temperature of 
the gas during the process but also perform a measure- 
ment in the number basis in each part of the cylinder, 
once the barrier is introduced into the cylinder. 

3. Depending on the result of the measurement the 
piston will be allowed to move quasi-statically to a posi- 
tion where the side-ways force acting on the piston will 
be zero. 

4. The piston is then quasi-statically removed by de- 
creasing the strength of the potential. 

In the classical case there is no need to invest work into 
the engine except during the erasure procedure - insertion 
of the piston, its removal as well as the measurement are 
considered to be " for free" . The only stage of extraction 
of energy is the movement of the piston resulting from 
the unequal pressure on either side. In contrast, in the 
the quantum case one inevitably has to invest energy to 
create the barrier (step 1.); this can however be recovered 
during the movement and removal of the barrier (steps 
3 and 4). In this picture the stages of movement and 
removal of the barrier need not anymore be considered 
as independent actions. The extraction of work can be 
equally well done by exploiting the force towards the side 
of the barrier as well as acting on the top of the barrier. 
Therefore throughout the manuscript we will only work 
with three phases of the engine - insertion, measurement 
and movement /removal phase. The combined work-cost 
of steps 3. and 4. shall be called W2. 

These four processes represent a closed cycle up to the 
point where the result of the measurement in step 2 is still 
stored somewhere. For a full restoration of the original 
setting one has to erase this information [J]. 

Low temperature limit. — In the first part of this 
Letter we will consider the system to be non-degenerate 
and assume the low temperature limit. Here, the quan- 
tum effects of the engine are expected to manifest them- 
selves in the strongest way - for high temperatures all 
particles became essentially distinguishable as each can 
be labelled by its energy. In what follows we shall de- 
note the energy levels of the particles in the cylinder 



without the barrier as Ei. We consider the condition 
kT <^ AE, where AE represents the difference between 
any two energy levels that could be potentially occupied 
- for bosons and distinguishable particles it is just the 
difference between two lowest energy levels of the sys- 
tem and for fermions AE represents the difference be- 
tween the Fermi energy and the nearest higher energy 
level. Under these assumptions the partition function 
of any system consisting of N bosons or distinguishable 
particles will be Zi, = exp (— A^£'i/fcT) with Ei being 
the lowest energy of the system. For fermions in a non- 
degenerate system the partition function will have the 

form Zf = cxp (- J2ti E^/kT^ . 

We will now calculate the work that can be extracted 
from the closed cycle of the SZE. This can be defined as 
W ~ kT In ^ with Zb being the partition function of 
the final state and Za being the partition function of the 
initial state. 

Insertion of the barrier. — For bosons there are two 
distinct possibilities for this step. Let us denote the en- 
ergy levels on the left(right) of the barrier as E^ ' . The 
first one corresponds to the case where wc do not in- 
sert the barrier in the middle of the system E[ > _B[. 
Quantities for this case will be labeled by index n so the 
final partition function will be ZJ^ = exp {—NEl/kT) , 
which physically means that all particles condensed in 
the lower potential well. This will result in a final 
work WV^ ~ N {El — E^) . Irrespective of the exact 
form of the potential defining the cylinder one can ex- 
pect El > El, as the "living space" of the particles 
has decreased and thus the work performed is negative. 
The second possibility corresponds to the case when the 
barrier is introduced in the middle of the system i.e. 
E[ ~ El . In this case quantities will be indexed by d and 
the precision is expected to be such that E[ — El ^ kT 
holds. Under such an assumption the partition sum 
{N + 1) cxp {-NEl/kT) and the work 
kTlii{N + l) + Wl^. 

For distinguishable particles the situation is quite sim- 
ilar to the above bosonic case. Again there is no limit on 
the number of particles occupying the lowest energy level. 
The only difference is for the degenerate case, where the 
particles can choose their positions without change of the 
total energy of the system. Here the number of possible 
configurations will be 2^ and the partition function will 
be Zj =: 2^ cxp {-NEl/kT). Here the cxtractablc work 
Wl'^ = N {kTln2 + Ei — El), simply corresponding to 
the case of joining N independent SZEs. 

For fermions the situation is distinctly different. We 
define j as the level for which following equality holds: 
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(1) 



First let us examine the case where there is sharp inequal- 
ity on the right hand side of ^ . The final partition func- 



tion will be ZV: 



e^p{~{j:LiEi + El7El)/kT) 



and the cxtractablc work will be Wl'^ 



Ej=1 Et 



. In contrast, for equality on 
of dl]) we get a degeneracy 



the right hand side ot (m wc 
in the energy levels of the whole system when the 
fermion at the Fermi level can freely choose either 
side of the cylinder and the partition function becomes 

Zf = 2exp (- (j:1^^ El + j:fj;' El) /kT^ and the ex- 
tractable work win be Wl'j = kT \i\{2) + W Vj . It is worth 
to mention that in contrast to the bosonic case there 
are potentially many (in the order of N) possibilities for 
choosing the position of the barrier to reach the equalized 
position, but insertion into the middle of the container 
will cost less work only for N odd. 

Measurement. — In the second step a measurement 
on the system is performed. This is only non-trivial 
if the energy levels of the final system (after insert- 
ing the barrier) are degenerate (with partition func- 
tions and works labelled by d) as in the other case it 
is just a single-outcome measurement confirming that all 
bosons/distinguishable particles are in the deeper well 
(larger part of the piston) or the fermions are distributed 
within the piston in a way expectable by the distribution 
of energy levels. 

In the non-trivial bosonic case, the full measurement 
will have TV -I- 1 possible outcomes counting the num- 
ber of particles on the left hand side. In the fermionic 
case the measurement will be binary and for distinguish- 
able particles the number of possible outcomes will be 
2^ (specifying the position of every single particle) . 

Movement and removal of piston. — In the classi- 
cal case one would extract the work by simply moving the 
piston to its equilibrium position. All extractable work 
would be extracted within this phase for an infinitely nar- 
row piston. On the other hand, if the piston was removed 
from a different position than the equilibrium one, part 
of the potential work would just dissipate due to mixing 
of gases with different pressures. In the quantum case 
the situation is much more subtle. Here the extraction of 
work is not straightforward to define physically in con- 
nection with possible storages of energy such as excited 
states of atoms. However, if we stick to the standard 
definition of the generalized force as F = ^ with A be- 
ing a parameter of the barrier (e.g. its position during 
the movement phase or height during the removal phase) 
and accept that any such force can be utilized to perform 
work, we can calculate the extractable work from the par- 
tition functions without making specific assumptions on 
the process itself. 

For both bosons and distinguishable particles the ini- 
tial partition sum of the system is Z^ = exp {—NEl/kT) 
and final is Zb- Therefore we get as the extractable work 
W2b = N {El — El) . For fermions the partition sum is 



Zf^ 
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ELi El + E:L7 El) /kT) and the ff 
the resulting work is W2f — J2i=i El -i 



El7Ei-j:liE,. 

Summing up. — The total work gained (or paid) dur- 
ing the relevant parts of the cycle is then Wb = Wd = 
Wf = for non-degenerate cases with trivial measure- 
ments. The degenerate cases are much more interesting. 
In the case of distinguishable particles Wd = NkT\n{2), 
corresponding to N independent SZEs, for bosons we get 
Wb = kTln{N + 1) and for fermions Wf = kTln{2). 
All these results (even for non-degenerate cases) are con- 
nected by a unifying formula of the form 



W = kTliiiM) 



(2) 



with M being the number of possible measurement out- 
comes, each of them occurring with equal probability. 
The work corresponds to the energy needed to erase a 
memory able to store the result of the measurement. 

We note that S. W. Kim et. al. [l| calculate the work 
yield during the removal of the barrier differently. They 
firstly lower the barrier to the point where tunnelling 
is practically unrestricted. They view any energy that 
could potentially be extracted here as lost. In the sec- 
ond phase where the barrier is removed and the "living 
space" of the particles is enlarged they do however ex- 
tract work. With this approach the net energy gained 
from the system in the low temperature limit is however 
always negative if the number of particles N > 2. Work 
could only be gained if all particles are found on one of 
the sides of the cylinder, resulting in extractable work in 
the order of kT with probability diminishing with large 
N. On the other hand, all other measurement results 
would lead to a loss of energy in the order of AE via 
tunnelling during the removal of the barrier phase. 

Coarse-grained measurements. — One may con- 
sider another way of exploiting particle statistics to try 
to violate the second law, by doing a coarse-grained mea- 
surement. Let us define a coarse-grained measurement 
with M outcomes labelled by m (running from 1 to M), 
each occurring with probability p„j. As 14^1 does not 
depend on the measurement it will not change. The par- 
tition sum for bosons and distinguishable particles af- 
ter the measurement with outcome m will have the form 
Z^ = -^ exp {-NEl/kT) . After the removal phase the 



partition sum will be Z^ - 
tractable work will thus be 



exp(-iV£'i/fcr). The ex- 



M 



W = -kT ^ pm In (p„i) , 



(3) 



which holds also for fermions with M = 2 and pi = 
P2 = 1/2. From this we see that also in this case the 
extractable work does not depend on the actual number 
and type of particles in the system, but only on the mea- 
surement and its possible outcomes (taking into account 
the fact that possible measurements are limited by the 
number and type of particles in the system) . For a fixed 



number of outcomes M the extractable work is maxi- 
mized for a measurement with equal probabihty of each 
outcome and will gain Wmax = kT\n[M). 

We note that the result in Eq. ^ can wc rewritten as 
W = TS with 



M 



S = -k ^p„Jn(p„) , 



(4) 



being the entropy of the measurement outcomes. This 
definition exactly corresponds to the definition of Gibbs 
entropy except that here one deals with the probabilities 
of measurement outcomes rather than with the probabil- 
ities of microstates. One might view this correspondence 
in the following way: by removing entropy S from the 
system by a measurement one is able to extract exactly 
W = TS of work from the system before it turns back to 
its original state. The extracted entropy has to be stored 
somewhere, or erased, costing exactly the same amount 
of work again [4| . (A net work yield can nevertheless be 
obtained if two reservoirs with different temperatures ex- 
ist and the erasure is performed whilst in contact with 
the colder one.) 

For a measurement of distinguishable particles, where 
one only measures the number of particles on each side, 
the extractable work will be 



W,i 



m=0 ^ ^ 



-^l^\,J,-.^^ 



(5) 



which is smaller than Wb for bosons, where the same 
measurement represents a full measurement of the sys- 
tem (reaching i^Wh for the limit of large A^ [8[). This 
can be explained by the smaller information value of the 
measurement outcome (with the same number of pos- 
sible outcomes iV + 1) for distinguishable particles in 
comparison to bosons - whereas for bosons any result 
is equally probable, for distinguishable particles only the 
results close to balanced are likely. 

Degeneracy. — Let us briefly discuss the possible de- 
generacies of energy levels in the system. For bosons and 
distinguishable particles they only play a role for the low- 
est energy level. If the degeneracy can be revealed by the 
measurement, the system will correspond to an advanced 
SZE with more than one barrier and more complicated 
measurement. If the degeneracy cannot be revealed, in- 
fluence will be exactly cancelled for the extractable work, 
however it would increase the work needed to insert the 
barrier. 

For fermions, if the Fermi energy level of the system is 
degenerate, more than one fermion can occupy the same 
energy. This can increase the number of particles ac- 
tually performing work in the system up to N . In this 
scenario fermions behave exactly like bosons, condens- 
ing into the lowest energy level and performing the same 
amount of work as bosons (if the degeneracies cannot be 



revealed by measurement) or distinguishable particles (if 
degeneracies can be revealed by the measurement). 

Summary and discussion. — We performed a de- 
tailed analysis of a Szilard engine in the low temperature 
limit where the working medium is either distinguish- 
able particles, bosons or fermions. We showed that the 
extractable work is determined by the information gain 
of the measurement performed on the system, regard- 
less of the working medium. We demonstrated in detail 
how things conspire to remove the dependence on the 
working medium in that sense. This latter contribution 
is arguably of the same type as Bennett's exorcism of 
Maxwell's daemon [j| in that it shows in what exact way 
the second law is not violated in this process. 

We also showed that if a full measurement on the sys- 
tem is performed (which is associated with a different 
amount of information gain in the different cases), dis- 
tinguishable particles exhibit a much larger potential to 
deliver work (scaling linearly with the number of parti- 
cles) relative to bosons (where it scales logarithmically). 
Fermions can only provide a fixed amount of work inde- 
pendent of the number of particles. 

Moreover we showed that for coarse-grained measure- 
ments the extractable work is again determined by the 
information gain of the measurement. This clarifies why 
the same kind of measurement (measuring the number 
of particles on either side of the piston) extracts more 
energy for bosons than for distinguishable particles. 

It would be interesting to provide experimental evi- 
dence for the results obtained, especially for the possi- 
bility to extract work with balanced measurement out- 
comes. One could think about cold atoms kept at a stable 
temperature bv a (larger amount) of different atoms, as 
suggested in [l[ . Another option would be to use photons 
in micro-cavities as the working media. Here the confine- 
ment potential is easily controllable and the barrier could 
consist just from an inserted mirror. 
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